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(54) Monitor camera system and method of displaying picture from monitor camera thereof 



(57) In a monitor camera system comprising a mon- 
itor camera making 360-degree panning rotation and 
more-than 90-degree tilting rotation and a control unit 
for controlling the monitor camera, for masking a privacy 
zone in a picture taken by the monitor camera, the con- 
trol unit sets mask data through the use of a contour 
parameter of a configuration of a mask zone for covering 
the privacy zone, while the monitor camera side holds 



the mask data to mask a portion of the picture with the 
mask zone defined on the basis of the mask data. Ac- 
cording to this monitor camera system, since only a por- 
tion of the picture is masked with the mask zone, it is 
possible to protect the privacy from the picture taken by 
the monitor camera without impairing the monitoring 
function. In addition, since the monitor camera holds the 
mask data, quick processing becomes feasible. 
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Description 

[0001] The present inventionrelates to a monitor (sur- 
veillance) camera system (or apparatus) covering 
360-degree monitoring area and a method of displaying s 
an image from the same, and more particularly to a mon- 
itor camera system and a camera picture displaying 
method, which are capable of producing a display so 
that a portion of an image is masked for the purpose of 
the protection of privacy. io 
[0002] So far, a monitor camera in which a camera 
and a rotatable table therefor are placed in a dome-like 
housing has been put on the market. This monitor cam- 
era is called a "compound camera 0 because of the cam- 
era being capable of, through movements of the rotata- is 
ble tables, rotating horizontally (pan) while rotating ver- 
tically (tilt). The compound camera can rotate through 
360 degrees without limitation in the pan directions, 
while rotating in an angular range between 0 degree and 
90 degrees, that is, from a horizontal direction to a ver- 20 
tical direction, in the tilt directions. In addition, through 
the manipulation of a controller, this compound camera 
can take a photograph at a desired angle or in a desired 
direction in a state installed on a ceiling of public facili- 
ties or the like. Still additionally, even if a target subject 25 
passes right under it, as Fig. 15 shows, immediately a 
camera 1 0 turns to right under, it can rotate 180 degrees 
around a lens thereof to chase the target subject con- 
tinuously, thus providing pictures throughout a monitor- 
ing area. 30 
[0003] Fig. 13 is an illustration of a state in which a 
controller 1 2 for controlling a compound camera 1 1 and 
a monitor 13 for displaying a picture taken through the 
compound camera 1 1 are connected through a coaxial 
cable 1 6 to the compound camera 1 1 . The controller 1 2 35 
functions as a control element and comprises a joystick 
14 and a numeric pad (numeric keys) 15. 
[0004] This compound camera 1 1 is designed so that 
a plurality of camera positions, for example, taking a di- 
rection to an entrance, a direction to an exit and a direc- *o 
tion to a window, are preset in the controller 1 2 in the 
form of identification numbers (ID). After preset, simply 
by inputting the ID corresponding to a camera position 
through the use of the numeric pad 15, the camera can 
be turned to take the preset direction. * 5 
[0005] In addition, the joystick 1 4 of the controller 1 2 
is manipulated for controlling the moving (rotating) 
speed of the camera 11. When the joystick 14 is tilted, 
as shown in Fig. 14, the camera 11 rotates in a tilting 
direction at a speed proportional to the movement com- so 
ponent of the joystick 1 4 in the vertical-axis direction and 
rotates in a panning direction at a speed proportional to 
the movement component thereof in the horizontal-axis 
direction. An operator checks pictures while viewing the 
monitor 1 3 and, when the rotating camera 1 1 catches a S5 
desired direction, the operator returns the joystick 14 to 
the neutral position to stop the rotations thereof in the 
tilting and panning directions. 



[0006] Furthermore, when such a camera is installed 
to monitor a public place, the camera has a function 
whereby limitation is imposed on the angle of rotation of 
that camera so that neighboring private houses do not 
appear on the screen (scene) or has a picture process- 
ing function whereby, if the camera develops a picture 
of the private houses, the picture thereof entirely turns 
black, thereby accomplishing the protection of privacy. 
[0007] However, with the conventional privacy pro- 
tecting method for use in a monitor camera system, a 
picture other than an area undergoing the protection al- 
so disappears because limitation is imposed on photo- 
graphing direction or the entire picture turns black, 
which causes impairment of the monitoring function. 
[0008] Meanwhile, a group including the inventors of 
the present invention has developed a new compound 
camera capable of rotating 180 degrees in tilting direc- 
tions while limttlessly rotating 360 degrees in panning 
directions. Although this compound camera can provide 
the increased degree of freedom in moving direction to 
functionally monitor a wider range, there is an additional 
need for a method to accomplish the privacy protection 
without reflecting on the monitoring function. 
[0009] Accordingly, the present invention has been 
developed with a view to eliminating the above-men- 
tioned problems, and it is an aim of the invention to pro- 
vide a monitor camera system and camera picture dis- 
playing method which are capable of protecting privacy 
from a camera picture without interfering with a moni- 
toring function. 

[0010] For this purpose, in accordance with an aspect 
of the present invention, a monitor camera system com- 
prises a monitor camera rotatable in panning directions 
and in tilting directions and control means for controlling 
the monitor camera, the monitor camera holding mask 
data to be used in masking a privacy zone in a picture 
taken by the monitor camera, while the control means 
masking a portion of said picture corresponding to said 
privacy zone on the basis of the mask data. 
[0011] In this case, the control means sets the mask 
data through the use of a contour parameter of a con- 
figuration of a mask zone for covering the privacy zone. 
More specifically, for setting the mask data, the control 
means uses, as the contour parameter, center coordi- 
nates and size coefficient of the mask zone configura- 
tion, center coordinates of said mask zone configuration 
and a radius of said mask zone configuration, or coor- 
dinates of a left upper vertex and a right lower vertex of 
the mask zone configuration. In addition, the setting of 
the mask data is made on a central portion of the picture 
taken by said monitor camera. 
[0012] Alternatively, in the monitor camera system, 
the monitor camera holds the mask data produced on 
the basis of center coordinates and one or more contour 
size parameters of the mask zone configuration. 
[0013] Furthermore, in the monitor camera system, 
the masking is inhibited in a region in which a tilt angle 
is below a predetermined value, and the control means 
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manages the number of masks included in one scene 
taken by the monitor camera, and inhibits the setting of 
masks, whose number exceeds a predetermined value, 
in the one scene. 

[0014] Still furthermore, in the monitor camera sys- 5 
tern, the mask data, together with a number or name 
indicative of a mask zone for covering the privacy zone, 
is held in the monitor camera, and when receiving the 
number or name from the control means, the monitor 
camera provides a display of a mask zone determined 
by the mask data held together with the number or 
name. That is, when receiving the number or name from 
the control means in a mask correction mode, the mon- 
itor camera provides a display of a mask zone corre- 
sponding to the number or name. Additionally, the mon- 
itor camera inverts vertically the mask data held therein 
when masking said privacy zone. 
[0015] Moreover, the setting or cancellation of the 
mask data is made only when a password is inputted to 
said control means, and a position of a mask zone for 
covering the privacy zone deviates from a central posi- 
tion of a screen displaying a picture taken by the monitor 
camera, the monitor camera corrects the configuration 
of the mask zone. Additionally, when a plurality of mask 
zones appears in one scene, the monitor camera con- 
verts the plurality of mask zones into one enlarged mask 
zone prior to masking processing. 
[001 6] Still moreover, in a case in which a mask zone 
is set on a screen for displaying a picture taken by the 
monitor camera, the control means controls a moving 
speed of the monitor camera to a mask processing abil- 
ity. 

[001 7] I n addition, in accordance with another aspect 
of the present invention, there is provided a method of 
displaying a picture taken by a monitor camera rotatable 
in panning directions and in tilting directions, the method 
comprising a step of masking a portion of the picture 
corresponding to a privacy zone on the basis of mask 
data set through the use of a contour parameter of a 
configuration of a mask zone for covering the privacy 
zone. 

[0018] In the picture display method, the masking is 
inhibited in a region in which a tilt angle is below a pre- 
determined value, and when the mask zone deviates 
from a central portion of a screen for displaying the pic- 
ture taken by the monitor camera, the mask zone con- 
figuration is corrected and displayed to cover the entire 
privacy zone. Additionally, the masking is stopped when 
a moving speed of the monitor camera exceeds a pre- 
determined value. 

[0019] Furthermore, in the picture display method, a 
number or name (character or symbol) is related to said 
mask data to be displayed together with said mask zone, 
and the mask zone is displayed in response to an input 
of the number or name for correction of the mask zone. 
[0020] Other aims and features of the present inven- 
tion will become more readily apparent from the follow- 
ing detailed description of the preferred embodiments 



taken in conjunction with the accompanying drawings in 
which: 

Fig. 1 is an illustration of a partially masked display 
of a picture taken by a compound camera system 
according to an embodiment of the present inven- 
tion; 

Fig. 2 is a flow chart showing an operation of the 
compound camera system according to the embod- 
iment of the invention; 

Fig. 3 is an illustration of masking zone setting on 
a screen in a method of displaying a picture from 
the compound camera system according to the em- 
bodiment of the invention; 

Figs. 4A and 4B are illustrations useful for explain- 
ing the coordinate of a masking zone in the com- 
pound camera picture displaying method according 
to the embodiment of the invention; 
Figs. 5A and 5B are illustrations of a coordinate 
transformation at vertical inversion in the compound 
camera picture displaying method according to the 
embodiment of the invention; 
Figs. 6A and 6B are illustrations of a coordinate 
transformation at horizontal inversion in the com- 
pound camera picture displaying method according 
to the embodiment of the invention; 
Figs. 7 A to 7C are illustrations of a transformation 
into a screen coordinate in the compound camera 
picture displaying method according to the embod- 
iment of the invention; 

Fig. 8 is an illustration useful for explaining a cor- 
rection of a mask involved in a panning rotation in 
the compound camera picture displaying method 
according to the embodiment of the invention; 
Fig. 9 is a side cross-sectional view showing a con- 
struction of the compound camera according to the 
embodiment of the invention; 
Fig. 10 is a plan cross-sectional view showing the 
construction of the compound camera according to 
the embodiment of the invention; 
Fig. 11 is a block diagram showing a configuration 
of the compound camera according to the embodi- 
ment of the invention; 

Fig. 12 is an illustration of another control system 
in the compound camera system according to the 
invention; 

Fig. 1 3 is an illustration of a control system of a com- 
pound camera system; 

Fig. 1 4 is an illustration for describing camera speed 
control in a compound camera system; and 
Fig. 15 is an illustration for describing an operation 
of a compound camera system. 

[0021] Embodiments of the present invention will be 
described hereinbelow with reference to the drawings. 
[0022] As the side cross-sectional view of Fig. 9 and 
the plan view of Fig. 10 show, in a compound camera 
system according to an embodiment of the invention, as 
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a compound camera, a housing comprising a cylindrical 
camera base 107 and a semispherical camera cover 
101 accommodates a monitor camera 102, a rotatable 
tilt table 105 for holding the camera 1 02 directly, a rotat- 
able pan table 1 03 capable of limitlessiy rotating 360 de- s 
grees, a pair of columns 113 planted on the rotatable 
pan table 103, a tilt rotary shaft 106 for rotatably sup- 
porting the rotatable tilt table 1 05 with respect to the col- 
umns 113, and a slip ring 112 acting as a contact for 
supply of power into the housing or for input/output of 
electrical signals. Although omitted from the illustration, 
the compound camera is additionally equipped with a 
rotating mechanism for the rotatable pan table 103 and 
the rotatable tilt table 104, a motor functioning as a ro- 
tational drive source, a drive control section for the mo- 
tor, an amplifying circuit for amplifying video signals, and 
a control section for controlling an operation of the com- 
pound camera system. In addition, a magnet 117 is fixed 
at an origin position for determining the origin of rotation 
in the panning direction, while a home-position (origin) 
Hall element 32 is placed on the rotatable pan table 103 
for detecting a magnetic field from the magnet 117. 
[0023] The rotatable tilt table 1 05, holding the camera 
102, is rotatable through 1 80 degrees around the tilt ro- 
tary shaft 106 and, therefore, the camera 102 is revers- 
ibly rotatable from a point A (designated at numeral 1 08 
in Fig. 9) through a lowermost point B (designated at 
numeral 109 in Fig. 9) to a point C (designated at nu- 
meral 110 in Fig. 9). 

[0024] On the other hand, the rotatable pan table 1 03 
is rotatable horizontally through 360 degrees as indicat- 
ed by a rotation locus (designated at numeral 206 in Fig. 
10). 

[0025] Furthermore, the slip ring 112 realizes the sup- 
ply of power from a fixed section to a moving section 
and the communication of electric signals between the 
fixed section and the moving section in the compound 
camera system. 

[0026] Accordingly, when this compound camera is 
installed, for example, on a ceiling 111 , the camera 102 
takes a photograph on a monitoring area in all directions 
in a manner that the angle of rotation of the rotatable tilt 
table 105 is controlled remotely and the rotatable pan 
table 103 is rotated in a predetermined direction. 
[0027] Fig. 11 is a functional block diagram showing 
an internal configuration of the compound camera. As 
a rotation control mechanism for the rotatable pan table 
103 and the rotatable tilt table 105, there are provided 
motors 24, 28, encoders 25, 29 for detecting speeds of 
rotation (revolutions) of the motors 24, 28 motor drivers 
23, 27 for driving the motors 24, 28 on the basis of the 
detection results of the encoders 25, 29, reduction 
mechanisms 26, 30 for reduction of the rotation of the 
motors 24, 28 to transmit the reduced rotations to the 
rotatable pan table 103 and the rotatable tilt table 105, 
respectively, an origin Hall element 32 placed on the ro- 
tatable pan table 103 and sensitive to a magnetic field 
of the magnet 117 situated at the pan origin, end-point 



Hall elements 33 located 180 degrees apart on the ro- 
tatable tilt table 105 and sensitive to magnetic fields of 
magnets placed at tilt end-point positions, a Hall ele- 
ment signal detecting section 31 for detecting the pan 
origin and the tilt end points on the basis of detection 
signals from the Hall elements 32, 33, and a motor con- 
trol section 22 for controlling the motor drivers 23, 27 in 
accordance with the detection results of the Hall ele- 
ment detecting section 31 . 

[0028] In addition, as a control mechanism for a cam- 
era lens section,, there are provided stepping (stepper) 
motors 36, 40 for zoom and focus adjustments, motor 
drivers 35, 39 for outputting drive pulses to the stepping 
motors 36, 40, respectively, reduction mechanisms 37, 
41 for reducing the rotations of the stepping motors 36, 
40 to transmit the reduced rotations to lens mecha- 
nisms, respectively, a limit switch (or photointerruptor) 
38 for detecting the limit of the zoom adjustment, a pho- 
tointerruptor 42 for detecting the limit of the focus ad- 
justment, a lens control section 34 for controlling the mo- 
tor drivers 35, 39, and a driver 43 for adjusting the iris. 
[0029] Still additionally, a camera section, outputting 
a video signal, is composed of an image pickup device 
(CCD) 44, a DSP 45 for encoding a video signal, and 
an image memory 46 in and from which image data is 
writable and readable. 

[0030] Moreover, in the compound camera system, 
are included a camera control section 21 for controlling 
an operation of the compound camera system in accord- 
ance with a control signal from a controller (not shown) 
and a memory (E 2 PROM) 47 for storing data. 
[0031] Still moreover, for example, the compound 
camera can be controlled in a state connected through 
a coaxial cable 16 to a controller 12 and a monitor 13 
as well as the system shown in Fig. 13, or as shown in 
Fig. 12, it can be connected through RS485 serial com- 
munication 1 8 to a personal computer 1 9 so that a com- 
pound camera 11 is controlled by the personal computer 
1 9 with a picture taken by the compound camera 1 1 and 
displayed on a screen of the personal computer 19. 
[0032] In the illustration, although one compound 
camera 11 is connected to the controller 12, it is also 
possible that a plurality of compound cameras are con- 
nected to the controller 12 to be controlled by the con- 
troller 12. 

[0033] First of all, a description will be given herein- 
below of a general operation of the compound camera. 
[0034] In this compound camera, the output pulses of 
the encoder 25 for detecting the rotation of the motor 24 
in a panning direction is sent to the motor control section 
22, and a point of time at which the home-position ele- 
ment 32 has detected the pan origin is communicated 
through the Hall element signal detecting section 31 to 
the motor control section 22. When the number of pulses 
to be outputted from the encoder 25 while the rotatable 
pan table 103 makes one revolution (during one revolu- 
tion of rotatable pan table 103) is taken as p, the motor 
control section 22 counts the number m of output pulses 
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of the encoder 25 from when the Hall element 32 has 
detected the pan origin to calculate the present pan an- 
gle P1 according to the following equation. The present 
pan angle Pi calculated thus is preserved in the memory 
47. 

Pi = m X 360/p 

[0035] Likewise, the output pulses of the encoder 29 
which detects the rotation of the motor 28 in a tilt direc- 
tion are forwarded to the motor control section 22, and 
the point of time at which the tilt end point has been de- 
tected by the end-point Hall element 33 is communicat- 
ed through the Hall element signal detecting section 31 
to the motor control section 22. When the number of 
pulses to be outputted from the encoder 29 while the 
rotatable tilt table 105 makes half a revolution (during 
half revolution of rotatable tilt table 105) is taken as q, 
the motor control section 22 counts the number n of out- 
put pulses of the encoder 29 from when the end-point 
Hall element 33 has detected a tilt end point, and calcu- 
lates the present tilt angle Ti according to the following 
equation. 

Ti = 90-(n X 180/q) 

[0036] That is, the tilt angle is taken as 0 when the 
camera 1 02 follows the right-under direction (just down- 
wardly) and the tilt angle is calculated with respect to 
the right-downward direction. The possible tilt angle 
ranges from + 90 degrees to - 90 degrees. The present 
tilt angle Ti calculated is retained in the memory 47. 
[0037] These pan angle Pi and the tilt angle TI indicate 
the present direction of the center of the camera face 
(picture). 

[0038] Furthermore, the field angle (angle of view) of 
a picture to be photographed depends upon the rotating 
quantity of the stepping motor 36 determining the zoom- 
ing quantity of the lens section or the electronic zoom 
magnification, while the rotating quantity thereof de- 
pends upon the number of pulses to be outputted to the 
stepping motor 36. When counting a pulse for rotating 
the stepping motor 36, the lens control section 34 counts 
it as "plus" when the stepping motor 36 is rotated for- 
wardly, while counting it as "minus" when the stepping 
motor 36 is rotated reversely, thus cumulatively calcu- 
lating the number of pulses outputted from the motor 
driver 35. The camera control section 21 expresses, in 
the form of tilt coordinates, the vertical field angle (Zt) 
of the field angle obtained from the cumulative number 
of pulses or the electronic zoom magnification, and ex- 
presses the horizontal field angle (Zp) in the form of pan 
coordinates, with these field angle components being 
stored in the memory 47. 

[0039] In this way, the values Pi, Ti, Zt and Zp are pre- 
served in the memory 47 as data representative of the 



present quantity of state of the compound camera. 
[0040] The operation of the compound camera (des- 
ignated at numeral 11 in Fig. 13) lies under control of 
the controller 12 or the personal computer 19. In the 

5 compound camera 1 1 , when the controller 1 2 or the per- 
sonal computer 1 9 transmits a command, and upon re- 
ceipt of the command therefrom, the camera control 
section 21 interprets the received command to control 
the respective portions. 

10 [0041] When an operator inclines the joystick 1 4 of the 
controller 12 for changing the camera facing direction, 
in response to this manipulation, the controller 1 2 sends 
a command for camera moving speed control to the 
compound camera 11 and transmits data Vpan indica- 

is tive of an x-axis component of the inclination of the joy- 
stick 14 and data Vtilt indicative of a y-axis component 
thereof, shown in Fig. 14, to the compound camera 11 . 
In the compound camera 11 , the camera control section 
21 interprets the received command, and sends the data 

20 Vpan and the data Vtilt to the motor control section 22. 
The motor control section 22 controls the motor driver 
23 so that the camera panning rotation is made at a 
speed corresponding to the data Vpan and further con- 
trols the motor driver 27 so that the camera tilting rota- 

25 Won is made at a speed corresponding to the data Vtilt. 
[0042] When the operator returns the joystick 14 to 
the neutral position, the controller 12 similarly sends a 
command and data representative of Vpan = 0 and Vtilt 
= 0 to the compound camera 11, thereby ceasing the 

30 camera rotation in the tilting direction and in the panning 
direction. 

[0043] At a change of the camera direction, the data 
Pi, Ti, Zt and Zp representative of the present quantity 
of state, as mentioned above, are updated and pre- 
35 served. 

[0044] The CCD 44 picks up an image in the direction 
the camera 102 takes, and outputs a video signal cor- 
responding to the image picked up to the DSP 45. The 
DSP 45 is for encoding an image, with the encoded im- 
40 age data being once written in the image memory 46 
and then read out from the image memory 46 to be out- 
putted to the monitor 1 3. 

[0045] In this compound camera system, the facing of 
the camera 102 in the opposite direction is realizable by 

45 changing the pan angle by 1 80 degrees without chang- 
ing the tilt angle, or by changing the tilt angle from the 
"plus" direction to the "minus" direction in a state where 
the pan angle remains intact. However, although the 
former does not cause inversion in the CCD 44, the latter 

50 leads to vertical (upside-down) inversion in the CCD 44. 
Therefore, in the case of the latter, there is a need to 
read out the data inversely from the image memory 46; 
otherwise, the image appears upside down. According- 
ly, the image data in the CCD 44 is put in the image 

55 memory 46 in like manner, but it is then read out invert- 
edly from the image memory 46 and forwarded to the 
monitor 13. This state, that is, a state in which the data 
Ti assumes a minus condition (value), will be referred 
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to hereinafter as a "vertical inversion state - . 
[0046] Likewise, the horizontal 90-degree rotation of 
the camera 1 02 is achievable by changing the pan angle 
by 90 degrees without changing the tilt angle, or by once 
returning the tilt angle to zero and then by enlarging the 
tilt angle 90 degrees in a different direction in the pan 
angle fixed condition. In the case of the latter, there is a 
need to read out the image data in the CCD 44 through 
the image memory 46 in the right-and-left inverted con- 
dition. This state will be referred to hereinafter as a "hor- 
izontal inversion state". 

[0047] Furthermore, as Fig. 1 shows, this compound 
camera system is designed so that a privacy zone ap- 
pearing in a picture is covered with a mask 50. In a case 
in which a picture is taken while the photographing di- 
rection is changed slowly by means of the automatic 
tracing, the mask position varies in accordance with the 
camera movement to cover the privacy zone on the 
screen (scene) continuously. However, in the compound 
camera system according to this embodiment, when the 
camera moving speed exceeds a certain value, even if 
a mask is absent, difficulty is experienced in identifying 
the privacy zone in the picture. Therefore, the privacy 
zone is not covered with the mask. In addition, the mask- 
ing region is not located in a tilt angle range between 
-45 to 45 degrees. This is, as will be mentioned later, 
because, when the tilt angle is small, a subject rotates 
in a relatively large quantity due to the pan rotation and, 
hence, a mask cannot work effectively, and because, if 
a privacy zone exists at a position in such a tilt angle 
range, in general a monitor camera is not installed at 
that position. 

[0048] The mask setting is made as follows through 
the use of the personal computer 19. 
[0049] When an operator selectively derives a mask 
setting procedure from the personal computer 1 9 so that 
a mask setting command is sent therefrom to the com- 
pound camera system. In the compound camera sys- 
tem, the camera control section 21 interprets this com- 
mand and gives an instruction for the maximum zoom 
tothe lens control section 34. At this time, a picture taken 
by this camera system and the data Pi, Tl, Zp and Zt 
representative of the quantity of state thereof are fed to 
the personal computer 1 9, with the picture appearing on 
a screen thereof. 

[0050] When the operator uses a mouse to designate 
the central position of a privacy zone in that picture, the 
personal computer 19 calculates the pan coordinates 
and the positive tilt coordinates corresponding to that 
central position and sends the calculation results to the 
compound camera system. In the compound camera 
system, the camera control section 21 gives a command 
to the motor control section 22 so that the center of the 
screen of the personal computer 1 9 turns at the pan co- 
ordinates and the tilt coordinates. In consequence, the 
central position of the set mask lies at the center of the 
screen of the personal computer 19. 
[0051] Following this, when the operator shifts the 



cursor on the screen thereof, as Fig. 3 shows, a rectan- 
gular zone frame established in a manner that the cursor 
position forms one comer appears, where the central 
position of a mask to be set coincides with the center of 

s the frame. The ratio of the vertical axis to the horizontal 
axis (aspect ratio) of this zone frame is fixed to 3:4 iden- 
tical to that of the screen. After en larging the zone frame 
to cover the privacy zone, the operator performs a mask 
zone setting operation. At this time, a number or name 

10 indicative of the mask zone is additionally set therein. 
[0052] The data on the center coordinates and the co- 
ordinates of one vertex defining the set mask zone, to- 
gether with the number thereof, is managed in the per- 
sonal computer 19. Additionally, the pan coordinates 

is and the tilt coordinates representative of that mask 
zone, together with the number thereof, are fed from the 
personal computer 1 9 to the compound camera system 
and put in the memory 47. In the display, a maximum of 
four mask zones can be set on the screen. 

20 [0053] At this time, the personal computer 19 calcu- 
lates coordinate data on three corners of the mask zone 
as a function of the center coordinates and the coordi- 
nates of one vertex forming the management data re- 
lated to the mask zone, and sends the calculated coor- 

25 dinate data to the compound camera system. Alterna- 
tively, it is also appropriate that the center coordinates 
and the coordinates of one vertex forming the manage- 
ment data on the mask zone are fed to the compound 
camera system, where these management data are 

30 stored and, when needed, used to calculate the coordi- 
nate data on the four corners of the mask zone. 
[0054] Figs. 4A and 4B are illustrations of data to be 
stored in the memory 47 of the compound camera sys- 
tem in conjunction with one mask zone. With respect to 

35 one mask zone, are stored three data (that is, HLy, LLy, 
HRy, HLx, LLx, HRx as shown in Fig. 4B) corresponding 
to the left upper end HL, the left lower end LL and the 
right upper end HR shown in Fig. 4A. The right lower 
end LR data is calculated according to LRx = HRx, LRy 

40 - LLy. 

[0055] Incidentally, the reason for setting the mask 
zone at the center of the screen is to prevent the distor- 
tion of a picture at the setting. Additionally, the reason 
for fixing the aspect ratio of the zone frame is to lessen 

45 the volume of data to be managed. 

[0056] Furthermore, a description will be given here- 
inbelowof privacy zone display processing operation af- 
ter the setting of a mask zone in the compound camera 
system. Fig. 2 is a flow chart showing the operation in 

50 the compound camera system. 

[0057] In the flow chart of Fig. 2, in a step 1 , the cam- 
era control section 21 examines whether or not the pan- 
ning speed or the tilting speed equals or exceeds a pre- 
determined speed. If the answer of the decision step 1 

55 shows that the panning speed or the tilting speed equals 
or exceeds the predetermined speed, the camera con- 
trol section 21 terminates this operation without con- 
ducting the privacy zone display processing operation. 
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On the other hand, if the decision step 1 shows that the 
panning speed or the tilting speed does not reach the 
predetermined speed, the operational flow advances to 
the next decision step 2. 

[0058] The decision step 2 is for checking whether or s 
not the tilt angle Ti is between - 45 degrees and 45 de- 
grees (-45° < tilt angle < 45°). If the answer of the deci- 
sion step 2 shows that the tilt angle Ti is between - 45 
degrees and 45 degrees, the camera control section 21 
also terminates this operation without conducting the 10 
privacy zone display processing operation. On the other 
hand, If the answer of the decision step 2 shows that the 
tilt angle Ti is out of the range between - 45 degrees and 
45 degrees, the operational flow proceeds to a further 
decision step 3. 75 
[0059] The decision step 3 is for checking whether or 
not the tilt angle Ti assumes a negative or minus value 
(tilt angle < 0). If the decision in this step 3 indicates 
"YES" (affirmative), the operational flow jumps to a step 
6. Otherwise, the step 3 is followed by a step 4 to convert 20 
the pan angle Pi into an angle in 180-degree opposed 
relation thereto. 

[0060] That is, in the step 4, in the case of Pi < 180°, 
an angle (Pi + 180°) is set as a pan angle, when Pi > 
180°, an angle (Pi - 180°) is set as a pan angle. 25 
[0061] After the execution of the step 4, the operation- 
al flow advances to a step 5. The step 5 is for converting 
the tile angle into (90o - Ti). That is, the processing of 
the steps 4 and 5 accomplishes the transformation into 
absolute pan coordinates (0 to 360°) and absolute tilt 30 
coordinates (0 to 180°). 

[0062] Thereafter, in a step 6, the camera control sec- 
tion 21 reads out mask data from the memory 47, and 
in a decision step 7, checks whether or not the com- 
pound camera system is currently in the vertical inver- 35 
sion state. If the answer of the decision step 7 indicates 
the vertical inversion state, a step 8 follows to inter- 
change the left upper end data HL and the left lower end 
data LL in the mask data, and further to interchange the 
right upper end data HR and the right lower end data *o 
therein. 

[0063] Fig. 5A is an illustration of data (tHL, tLL, tHR, 
tLR) after the interchange processing, while Fig. 5B is 
an illustration of data for when the interchange process- 
ing is unnecessary. 45 
[0064] Furthermore, a decision step 9 is implemented 
to check whether or not the horizontal inversion state is 
going on currently. If the answer of the decision step 9 
indicates the horizontal inversion state, a step 1 0 follows 
to interchange the left lower end data LL and the right so 
lower end data LR and further to interchange the left up- 
per end data and the right upper end data HR . 
[0065] Fig. 6A is an illustration of data (tHL, tLL, tHR, 
tLR) after this interchange processing, while Fig. 6B is 
an illustration of data for when the interchange process- S5 
ing is unnecessary. 

[0066] Still furthermore, in a step 11 , the camera con- 
trol section 21 converts the mask data, expressed with 



the absolute coordinates, into screen coordinates. As 
Figs. 7A to 7C show, this is transformation processing 
for paning (setting) the mask zone (tHL, tLL, tHR, tLR) 
in the present screen whose center is at (Pi, Ti), and 
horizontal and vertical lengths are taken to be Zp and 
Zt, respectively. As Fig. 7A shows, if the mask zone is 
out of the present screen, the data tHL and tHR, tLL and 
tLR are transformed into points on the border lines of 
the present screen (tHL = tHR, tLL = tLR), and no display 
of the mask zone takes place. 

[0067] Furthermore, as Fig. 7B shows, if a portion of 
the mask zone is out of the present screen, the deviation 
mask zone data (tHL, tHR, tLL) are transformed into 
points on the border lines of the screen so that a zone 
partitioned by the points obtained by the transformation 
and the data tLR is displayed as a mask zone. 
[0068] Still furthermore, as Fig. 7C shows, in a case 
in which all the mask zone data lie within the present 
screen, a display of an area partitioned by the data (tHL, 
tLL, tHR, tLR) appears as a mask zone. 
[0069] Following this, a step 12 is implemented to 
convert the mask zone, transformed into the screen co- 
ordinates, into data corresponding to the pixels of the 
CCD 45, with the converted data being outputted to the 
DSP 45. Then, the operational flow enters display 
processing. This mask zone is display in color such as 
black on the screen, and is displayed together with a 
mask number, symbols (private house mark, toilet room 
mark or the like) and other marks according to the cir- 
cumstances. 

[0070] For correction of this mask zone, the operator 
inputs a mask number and implements a mask setting 
procedure. The camera control section 21 of the com- 
pound camera system reads out the mask data corre- 
sponding to the inputted mask number from the memory 
47, and controls the motor control section 22 so that the 
mask zone appears at the central portion of the screen. 
In a state where the mask zone exists at the central por- 
tion of the screen, the operator conducts an operation 
such as panning/tilting or zooming, which erases the 
mask zone so that new zone setting becomes possible. 
[0071] Furthermore, as Fig. 8 shows, even if a subject 
is in a fixed condition, a picture of the subject rotates in 
the screen in connection with the pan rotation. This var- 
iation occurs more greatly as the tile angle approaches 
an angle at which the camera follows the right-under di- 
rection. Therefore, when the pan angle varies from the 
angle at the mask setting, the privacy zone rotates in 
the screen so that a portion thereof becomes out of the 
mask to be visible. This problem is avoidable by calcu- 
lating a mask zone needed for covering the present pri- 
vacy zone (that is, the mask position at the mask zone 
setting) on the basis of the pan angle at the mask zone 
setting and the present pan angle to update the mask 
zone. 

[0072] In addition, a large field angle can obviate a 
possibility of violating the privacy even if a small mask 
disappears. Accordingly, it is also appropriate to ON/ 
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OFF-control (make/cease) the masking according to a 
field angle. Still additionally, it is also appropriate to ex- 
ecute control so that a mask which becomes smaller 
than a predetermined value on a monitor screen does 
not become further smaller. This control can lighten the 
arithmetic processing for changing, the mask area in 
connection with a field angle. Incidentally, there is a pos- 
sibility that an extremely small mask is misunderstood 
as a defect or failure. 

[0073] Furthermore, in a case in which the camera ro- 
tating speed is high, the masking is stopped as men- 
tioned above. This is because additional consideration 
is given to the fact that the mask zone coordinate cal- 
culation cannot catch up with the high camera rotation. 
On the contrary, it is also appropriate to control the cam- 
era rotating speed for enabling the masking calculation 
to follow it. 

[0074] Still furthermore, the personal computer 19 
has a function to count the number of times of masking 
(the number of masks) and, whenthenumber of times 
of masking exceeds a predetermined value, inhibits fur- 
ther setting of a mask zone. A high frequency defies the 
follow-up of the processing in the compound camera 
system. In this case, it is also possible to covera plurality 
of mask zones with one mask, thereby decreasing the 
number of times of masking. Additionally, in a case in 
which a plurality of masks are set in one scene, it is also 
appropriate that these masks are converted into a large 
mask including all of these masks prior to the masking 
processing, which can shorten the processing time. 
[0075] Moreover, in this embodiment, the cancellation 
and setting of a mask can be made through the use of 
a right password assigned to only a specific person, 
thereby preventing an operation by another person. 
[0076] Still moreover, in this embodiment, although, 
for easy management of mask zone data, a mask zone 
is set with the center coordinates and one vertex of a 
rectangle, it is also possible to use two vertexes of a left 
lower vertex and a right upper vertex or to use the center 
coordinates and a contour or configurational size pa- 
rameter such as a mask radius. 
[0077] Furthermore, in the above description, al- 
though this embodiment relates to a monitor camera 
system in which a camera can rotate 360 degrees in a 
panning direction and rotate 180 degrees in a tilting di- 
rection, the present invention is also applicable to a 
monitor camera system which performs different pan ro- 
tation and tilt rotation. 

[0078] As described above, since the monitor camera 
system and displaying method according to the present 
invention are designed to mask only an area on a screen 
needed for protection of privacy, it is possible to protect 
the privacy without impairing its function. 
[0079] In addition, in this monitor camera system, 
mask data exists on the camera side, which prevents a 
delay on control stemming from transmission delay, thus 
providing high responsiveness and exhibiting high re- 
sponse performance. 



[0080] It should be understood that the foregoing re- 
lates to only preferred embodiments of the present in- 
vention, and that it is intended to cover all changes and 
modifications of the embodiments of the invention here- 
s in used for the purpose of the disclosure, which do not 
constitute departures from the scope of the invention. 
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1. A monitor camera system comprising: a monitor 
camera rotatable in panning directions and in tilting 
directions; control means for controlling said moni- 
tor camera, and storage means for storing mask da- 

is ta to be used in masking a privacy zone in a picture 
taken by said monitor camera, while said control 
means masking a portion of said picture corre- 
sponding to said privacy zone on the basis of said 
mask data. 

20-- 

2. A monitor camera system according to claims 1 , 
wherein said control means sets mask data through 
the use of a contour parameter of a configuration of 
a mask zone for covering said privacy zone. 

25 

3. A monitor camera system according to claim 2, 
wherein the setting of said mask data is made on a 
central portion of said picture taken by said monitor 
camera. 

30 

4. A monitor camera system according to claim 2 or 3, 
wherein said control means uses, as said contour 
parameter, center coordinates and size coefficient 
of said mask zone configuration for setting said 

35 mask data. 

5. A monitor camera system according to claim 2 or 3, 
wherein said control means uses, as said contour 
parameter, center coordinates of said mask zone 

40 configuration and a radius of said mask zone con- 
figuration for setting said mask data. 

6. A monitor camera system according to claim 2 or 3, 
wherein said control means uses, as said contour 

45 parameter, coordinates of a left upper vertex and a 
right lower vertex of said mask zone configuration 
for setting said mask data. 

7. A monitor camera system according to any one of 
so the preceding claims, wherein said storage means 

holds said mask data produced on the basis of cent- 
er coordinates and one or more contour size param- 
eters of said mask zone configuration. 

55 8. A monitor camera system according to any of the 
preceding claims, wherein the masking is inhibited 
in a region in which a tilt angle is below a predeter- 
mined value. 
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9. A monitor camera system according to any one of 
the preceding claims, wherein said control means 
manages the number of masks included in one 
scene taken by said monitor camera, and inhibits 
the setting of masks, whose number exceeds a pre- 
determined value, in the one scene. 

10. A monitor camera system according to any one of 
the preceding claims, wherein said storage means 
stores said mask data, together with a number or 
name indicative of a mask zone for covering said 
privacy zone. 

11. A monitor camera system according to claim 10, 
wherein, when receiving said number or said name 
from said control means, said monitor camera pro- 
vides a display of a mask zone determined by said 
mask data held together with said number or said 
name. 

12. A monitor camera system according to claim 11, 
wherein, when receiving said number or said name 
from said control means in a mask correction mode, 
said monitor camera provides a display of a mask 
zone corresponding to said number or said name. 

13. A monitor camera system according to any one of 
the preceding claims, wherein said monitor camera 
inverts vertically said mask data held therein when 
masking said privacy zone. 

14. A monitor camera system according to any one of 
the preceding claims, wherein setting or cancella- 
tion of said mask data is made only when a pass- 
word is inputted to said control means. 

15. A monitor camera system according to any one of 
the preceding claims, wherein, when a position of 
said mask zone for covering said privacy zone de- 
viates from a central position of a screen displaying 
a picture taken by said monitor camera, said mon- 
itor camera corrects a configuration of said mask 
zone. 

16. A monitor camera system according to any one of 
the preceding claims, where, when a plurality of 
mask zones appears in one scene, said monitor 
camera converts said plurality of mask zones into 
one enlarged mask zone prior to masking process- 
ing. 
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18. A method of displaying a picture taken by a monitor 
camera rotatable in panning directions and in tilting 
directions, said method comprising a step of mask- 
ing a portion of said picture corresponding to a pri- 

s vacy zone on the basis of mask data set through 
the use of a contour parameter of a configuration of 
a mask zone for covering said privacy zone. 

19. A picture display method according to claim 18, 
io wherein the making is inhibited in a region in which 

a tilt angle is below a predetermined value. 

20. A picture display method according to claim 1 8 or 
19, wherein, when said mask zone deviates from a 

?s central portion of a screen for displaying the picture 
taken by said monitor camera, said mask zone con- 
figuration is corrected and displayed to cover the 
entire privacy zone. 

20 21. A picture display method according to claim 18, 1 9 
or 20, wherein the masking is stopped when a mov- 
ing speed of said monitor camera exceeds a prede- 
termined value. 

25 22. A picture display method according to claim 18, 1 9, 
20 or 21 , wherein a number or name is related to 
said mask data to be displayed together with said 
mask zone. 

30 23. A picture display method according to claim 22, 
wherein said mask zone is displayed in response to 
an input of said number or said name for correction 
of said mask zone. 

35 24. A computer program comprising code means for in- 
structing a computer to perform the steps of the 
method of any one of claims 18 to 23. 
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17. A monitor camera system according to any one of 
the preceding claims, where, in a case in which a 
mask zone is set on a screen for displaying a picture 
taken by said monitor camera, said control means 55 
controls a moving speed of said monitor camera to 
a mask processing ability. 
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FIG. 2 
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FIG. 8 
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